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1.  Introduction  and  Overview 


1.1  Introduction 

Decentralized  decision  making  is  ubiquitous  in  both  man  made  (artificial)  systems  and 
biological  (natural)  systems.  As  systems  become  more  complex,  with  many 
interconnected  subsystems,  decentralized  control  becomes  essential.  Examples  of  such 
systems  include  Economic  Systems,  Communication  Networks,  Transportation  Systems, 
Power  Systems  and  Unmanned  Air  Vehicles  (UAV). 

In  economic  markets  with  millions  of  buyers  and  sellers,  the  traders  do  not  make 
decisions  collectively.  Instead,  the  price  of  any  commodity  or  stock  is  the  only  commonly 
available  variable,  and  the  collective  decisions  of  all  individuals  decides  the  price.  In 
communication  networks  messages  from  multiple  source  nodes  are  routed  to  multiple 
destination  nodes.  To  avoid  congestion  and  improve  the  overall  performance  of  the 
network,  a  better  understanding  of  the  effects  of  decentralization  is  needed.  In 
transportation  systems,  where  millions  of  hours  are  being  wasted  every  day,  it  is  now 
recognized  that  the  solution  of  decentralized  control  problems  will  require  novel  concepts 
in  the  future.  Events  like  the  blackout  in  New  York  serve  to  remind  us  that  our 
understanding  of  the  stability  of  interconnected  power  systems  is  still  rather  limited.  At 
the  present  time  there  is  a  great  deal  of  interest  in  the  design  of  unmanned  air  vehicles  in 
high-risk,  time-critical,  and  high-pay-off  situations.  Such  systems  must  be  capable  of 
collecting,  correlating,  and  sharing  available  data  for  collision  avoidance,  contingency 
planning,  and  to  perform  cooperative  tasks.  All  these  require  a  much  deeper 
understanding  of  decentralized  control  systems  than  we  currently  possess. 


1.2  Biological  Motivations 

Biological  systems  cope  easily  and  effectively  with  changes  in  their  environments. 
Unlike  artificial  systems  there  is  a  seamless  integration  in  them  of  the  activities  of  the 
many  agents  involved.  Through  evolution,  ants,  wasps,  bees,  birds,  and  fishes  etc  have 
developed  extremely  efficient  methods  for  finding  food,  dividing  labor,  feeding  the 
colony,  and  responding  to  external  challenges.  All  these  reveal  that  nature,  has  come  up 
with  novel  solutions  to  complex  problems  which  need  to  be  better  understood.  More 
specifically,  question  such  as  relation  between  simple  individual  behavior  and  complex 
collective  behavior,  the  principles  that  govern  the  stability  of  the  equilibrium  state  of  the 
community,  the  process  by  which  cooperation  arises  among  a  multiplicity  of  agents,  must 
all  be  investigated  in  detail  analytically. 
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1.3  Decentralization  and  Uncertainty 


There  is  always  uncertainty  that  is  associated  with  decentralization.  However,  uncertainty 
(due  to  parameter  variations,  poor  modeling,  and  external  disturbances)  can  also  exist 
without  decentralization.  The  model  used  to  represent  a  specific  decentralized  situation 
depends  upon  the  degree  to  which  decentralization  and  uncertainty  are  important  in  it. 
The  broad  field  of  adaptive  control  has  developed  over  the  past  forty  years  as  an  effective 
control  methodology  for  dealing  with  uncertainty.  This  accounts  for  the  title  of  the 
project,  which  includes  both  decentralized  control  as  well  a  decentralized  adaptive 
control. 


1.4  Objective  of  the  Proposed  Research 

From  the  history  of  control  theory  it  is  well  known  that  efficient  design  principles  could 
be  developed  for  linear  time-invariant  (LTI)  systems  and  (linear)  adaptive  systems  only 
when  their  stability  properties  were  well  understood.  The  PI  adopts  the  same  viewpoint 
towards  the  decentralized  control  of  complex  interconnected  systems,  and  believes  that 
their  stability  properties  must  be  understood  before  their  design  can  be  attempted  with 
confidence. 

When  a  number  of  subsystems  are  interconnected,  and  each  subsystem  has  parametric 
uncertainty  as  well  as  disturbances  (from  unknown  signals)  from  other  subsystems,  the 
overall  system  may  become  unstable.  Detennining  the  strategies  by  which  the  different 
subsystems  must  compute  their  control  input  to  ensure  stability  is  consequently  an 
important  question.  It  is  only  after  conditions  for  stability  are  well  understood  can  the 
designer  focus  his/her  attention  on  improving  the  perfonnance  of  individual  subsystems. 
The  first  objective  of  this  project  was  to  study  in  detail  the  stability  of  interconnected 
systems  with  no  communication  between  the  subsystems  and  later  to  extend  the  results  to 
the  case  where  communication  between  subsystems  is  permitted.  Following  this,  the 
objective  of  the  project  was  to  detennine  methods  for  improving  the  performance  of  the 
overall  system  within  a  stability  framework. 


1.5  Statement  of  the  Problems 

N  subsystems  Si,  X2, .  .  .,  X,v  are  interconnected  to  form  a  network  of  systems  (e.g.  power 
systems).  Each  subsystem  is  a  dynamical  system  and  has  unknown  or  time-varying 
parameters.  Each  subsystem  X,  has  also  a  well  defined  objective  (i.e.  that  its  output  must 
follow  a  specified  function  of  time  y^).  The  fact  that  the  objective  has  to  be  accomplished 
in  the  presence  of  uncertainty  makes  each  subsystem  adaptive.  In  addition  to  local 
uncertainty  it  is  also  assumed  that  each  subsystem  X,  is  affected  by  signals  from  one  or 
more  of  the  other  subsystems  X,  (j  ±  i )  and  that  these  signals  are  not  known  to  X,.  If  X,- 
were  to  choose  its  control  input  without  knowledge  of  these  signals  from  the  other 
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subsystems,  its  output  will  not  be  able  to  follow  the  desired  output.  More  to  the  point, 
since  this  applies  to  all  the  other  subsystems  also,  the  overall  system  may  become 
unstable.  Hence,  two  questions  need  to  be  answered  in  the  strictly  decentralized  case. 

(i)  If  the  overall  system  is  to  be  stable  what  prior  information  concerning  the  other 
subsystems  will  be  needed  to  control  each  subsystem  in  the  network? 

(ii)  Is  it  theoretically  possible  to  control  each  subsystem  so  that  all  the  subsystems 
achieve  their  objective  of  following  their  desired  outputs  asymptotically  with  zero 
error? 

In  the  late  1990s  researchers  found  partial  answers  to  question  (i).  In  January  2000  the  PI 
made  a  conjecture  concerning  Problem  (ii).  Qualitatively,  this  conjecture  states  that  all 
the  subsystems  could  achieve  their  objectives  if  each  subsystem  is  aware  of  the  goals  of 
the  other  subsystems.  In  other  words,  the  desired  outputs  of  all  N  subsystems  should  be 
common  knowledge.  After  two  years  of  theoretical  investigation,  the  conjecture  was 
verified  analytically  for  a  simple  class  of  linear  systems  with  linear  interactions.  The 
research  carried  out  in  this  contract  was  strongly  influenced  by  the  above  result  for  two 
very  different  reasons  that  are  given  below 

(i)  The  conjecture  was  verified  for  only  simple  systems.  For  use  in  practical 
engineering  problems,  it  would  be  desirable  to  determine  the  most  general  class  of 
systems  for  which  it  is  valid. 

(ii)  As  mentioned  in  the  introduction,  there  are  a  large  number  of  natural  systems 
in  existence  where  complex  overall  system  behavior  results  from  simple 
interaction  of  individual  members.  The  conjecture  raises  the  possibility  that 
similar  simple  explanations  can  be  found  for  the  behavior  observed  in  those 
systems  as  well. 

In  this  project,  the  following  three  sets  of  problems  were  posed  for  further  investigation: 

(i)  The  first  deals  with  the  strictly  decentralized  control  system  discussed  thus  far. 
For  all  the  systems  investigated  simulation  studies  would  have  to  be  carried  out  to 
determine  how  they  would  perform  under  real  world  conditions. 

(ii)  In  the  second  set  of  problems  the  restriction  concerning  communication 
between  subsystems  should  be  removed  and  stability  issues  should  be 
investigated.  Once  again,  for  cases  where  stability  can  be  assured,  methods  for 
improving  performance  within  a  stability  framework  should  be  undertaken. 

(iii)  While  achieving  the  objectives  of  individual  subsystems  (and  hence  of  the 
collective)  is  important,  the  cost  of  communication  should  also  be  taken  into 
account  while  proposing  control  strategies.  In  particular,  methods  must  be 
investigated  to  detennine  the  minimum  amount  of  communication  that  will  be 
needed  to  keep  the  output  errors  of  the  N  subsystems  within  specified  limits. 
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1.6  Contributions  of  the  Project 


Work  carried  out  for  the  project  has  conclusively  shown  that 

(a)  The  conjecture  is  applicable  to  a  wide  class  of  dynamical  systems.  This  result 
alone  has  extended  significantly  the  class  of  theoretical  problems  to  which 
adaptive  control  can  be  applied. 

(b)  Simulation  studies  on  strictly  decentralized  control  systems  revealed  that  such 
systems  are  very  sensitive  to  initial  parameter  and  output  errors.  Hence,  it  was 
concluded  that  for  designing  practically  viable  interconnected  systems, 
communication  between  subsystems  should  be  pennitted. 

Partial  communication  between  subsystems  raises  difficult  stability  questions 
described  later  in  this  report.  Another  important  contribution  of  the  project  was 
the  proof  of  stability  of  interconnected  systems  with  partial  communication. 

(c)  Since  the  stability  proofs  given  in  (b)  demonstrate  that  the  overall  system  can 
be  made  stable  no  matter  when  the  different  subsystems  communicate  with  each 
other,  they  naturally  lead  to  the  question  as  to  when,  what,  and  with  whom  each 
subsystem  should  communicate  to  achieve  satisfactory  performance  while 
minimizing  communication  costs.  Heuristic  rules  for  determining  this 
demonstrated  that  significant  improvement  in  perfonnance  (comparable  to  that 
resulting  from  total  communication)  could  be  achieved  by  communicating  at 
critical  instants  of  time. 


2.  Work  Accomplished 


2.1  Strictly  Decentralized  Adaptive  Control 

The  problem  of  strictly  decentralized  adaptive  control  may  be  stated  as  follows:  Every  set 
of  (N  —  1)  subsystems  affect  the  input  to  the  Nth  subsystem,  in  a  network  composed  of  N 
subsystems.  The  inputs  to  the  Mh  system  are  output  variables  of  the  other  subsystems, 
and  are  generally  unknown.  The  question  that  is  to  be  addressed  is  the  strategy  that  each 
subsystem  should  take  so  that  all  the  signals  in  the  system  are  bounded,  and  if  possible 
the  outputs  of  the  subsystems  follow  their  desired  outputs  exactly  as  t  — *  oo. 

In  the  work  that  was  carried  out  before  2002  most  of  the  workers  treated  the  outputs  of 
the  other  subsystems  as  “disturbances”  and  attempted  to  derive  conditions  under  which 
the  overall  system  would  have  bounded  outputs.  In  2002  the  PI  and  his  graduate  student 
showed  that  if  the  various  controllers  used  desired  values  instead  of  the  true  values  of  the 
signals,  all  errors  would  eventually  converge  to  zero.  However,  this  was  demonstrated  for 
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two  linear  systems  all  of  whose  relevant  variables  (state  variables)  are  accessible.  Further, 
both  systems  are  linear  with  unknown  parameters  and  interconnections  between  them. 


The  work  done  during  the  first  part  of  the  project  aimed  at  demonstrating  that  this  result 
would  also  carry  over  to  a  large  class  of  systems.  This  was  accomplished  early  in  2005. 

The  first  extension  was  to  interconnected  systems  when  the  interconnections  are 
nonlinear.  However,  to  make  the  problems  mathematically  tractable,  several  assumptions 
had  to  be  made  about  the  nonlinear  functions.  Finding  conditions  for  stability  involved 
determining  non-quadratic  Lyapunov  functions,  an  area  in  which  relatively  little  work  has 
been  done.  The  above  positive  result  prompted  the  PI  and  his  graduate  students  to 
investigate  more  general  interconnected  systems. 

In  the  next  stage,  attempts  were  made  to  extend  subsystems  where  each  subsystem  has 
access  only  to  its  output  and  not  all  the  relevant  (state)  variables. 

For  special  classes  of  such  systems  it  was  shown  that  relatively  simple  adaptive  laws 
could  be  derived  using  the  available  information.  However,  the  problem  becomes  quite 
involved  mathematically.  Simulation  results  were  also  carried  out  to  ensure  that  all  the 
error  signals  did  converge  to  zero. 

Attempts  to  extend  the  results  to  more  general  classes  of  systems  (with  all  the  state 
variables  not  accessible)  required  estimates  of  these  variables.  This  consequently 
involved  considerably  more  mathematical  machinery  involving  both  observers  and 
backstepping.  However,  the  problem  was  finally  resolved. 

As  a  result  of  all  the  above  efforts  it  was  concluded  that  the  idea  that  desired  values 
(known  a  priori)  in  place  of  actual  values  (measured  on-line)  could  still  result  in 
asymptotic  stability,  was  a  general  adaptive  principle  applicable  to  a  large  class  of 
dynamical  systems. 

As  stated  earlier,  simulation  studies  on  strictly  decentralized  control  systems  using  the 
approach  was  carried  out  concurrently.  Even  though  the  theory  is  very  attractive,  the 
practical  application  of  the  principle  was  disappointing.  For  relatively  small  parametric 
uncertainly  and  large  errors  in  initial  conditions  of  some  variables,  the  errors  were  found 
to  be  quite  large.  It  was  there  fore  decided  that  control  problems  where  subsystems  can 
communicate  with  each  other  should  be  investigated  next. 


2.2  Decentralized  Adaptive  Control  with  Communication 

The  Principal  difficulty  in  proving  the  stability  of  the  systems  discussed  in  the  previous 
section  lies  in  the  fact  that  the  relevant  signals  in  the  other  subsystems  that  affect  a 
specific  subsystem  are  not  accessible  to  it.  This  accounted  for  using  their  desired  values 
in  the  adaptive  laws.  If  however,  the  subsystems  could  communicate  with  each  other, 
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they  could  convey  the  information  needed  to  make  the  system  stable  (i.e.  the  values  of 
the  corresponding  variables). 

If  communication  between  subsystems  is  permitted,  an  extreme  case  would  correspond  to 
every  subsystem  communicating  with  ever  other  subsystem  at  every  instant!  In  this  case 
the  system  is  no  longer  decentralized,  and  the  results  will  be  identical  to  that  obtained 
with  a  centralized  controller. 

The  problem  therefore  is  to  determine  when  any  subsystem  should  communicate  with 
another.  This  in  turn  led  to  the  problem  of  stability  when  every  subsystem  receives 
information  from  others,  not  at  all  instants  but  only  intermittently.  Assuming  that  a 
subsystem  receives  information  in  such  a  fashion  what  strategy  should  it  adopt?  When 
the  true  values  of  the  signals  are  known,  simple  stable  adaptive  laws  for  generating  the 
input  can  be  easily  determined.  In  the  absence  of  such  information  the  subsystem  has  to 
use  prior  information  and  that  could  involve  the  desired  values  of  the  same  signals.  With 
intennittent  communication,  it  is  clear  that  the  subsystem  has  to  switch  between  two 
different  strategies  -  one  using  the  true  value  of  the  “disturbing”  signals  and  the  other 
using  their  desired  values. 

A  substantial  amount  of  work  has  been  done  in  the  past  fifteen  years  on  the  stability  of 
switching  systems.  It  has  been  shown  that  if  a  common  Lyapunov  function  exists  for  two 
dynamical  systems,  then  a  system  switching  between  them  at  arbitrary  instants  is  globally 
stable.  In  the  context  of  interconnected  systems,  where  all  the  subsystems  switch  between 
two  strategies,  it  becomes  necessary  to  find  a  common  global  Lyapunov  function.  This 
was  accomplished  by  the  PI  and  his  colleagues,  and  is  scheduled  to  appear  as  a  paper  in  a 
special  issue  of  the  Institute  of  Electrical  Engineers  of  the  United  Kingdom  in  September, 
2006.  (see  Appendix  ) 

The  results  described  above  imply  that  the  existence  of  a  common  Lyapunov  Function 
decouple  completely  the  problem  of  stability  and  performance.  Since  stability  is  assured, 
every  subsystem  is  free  to  choose  when  to  communicate  with  the  other  subsystems  to 
improve  performance. 


2.3  Communication  and  Optimization 

In  the  last  stage  of  the  project,  conditions  for  improving  performance  were  investigated 
by  detennining  when  communications  should  take  place.  Extensive  simulation  results 
were  carried  out,  some  of  which  are  described  in  Section  3.  As  seen  from  these  studies, 
communication  at  some  critical  moments  can  substantially  improve  performance.  So 
determining  when  communication  should  take  place  was  posed  as  an  optimization 
problem.  The  perfonnance  criterion  used  in  the  optimization  procedure  depends  both  on 
the  cost  of  communication  as  well  as  the  performance  of  the  overall  system  as 
represented  by  the  output  errors.  Work  in  this  area  was  in  progress  when  the  project  was 
tenninated. 
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3.  Experimental  Results 


Extensive  simulation  studies  were  carried  out  both  on  continuous-time  systems  and 
discrete  time  systems  to  verify  the  theoretical  results  described  in  Section  2.  While  there 
are  essential  differences  between  the  theory  of  adaptive  systems  in  continuous  and 
discrete  time,  the  experimental  results  observed  in  simulation  studies  in  the  two  cases 
were  quite  similar. 

The  experiments  were  carried  out  on  two  classes  of  systems.  The  first  included  only  two 
interconnected  systems  so  that  the  effect  of  different  parameters  could  be  critically 
investigated. 

In  the  second  class,  the  behavior  of  six  interconnected  subsystems  was  studied.  In  the 
latter  case,  thirty  interconnections  are  possible  making  the  system  both  complex  and 
realistic 


3.1  Simulation  Studies:  (Two  Interconnected  Systems) 

Even  without  the  interconnection,  the  two  individual  subsystems  can  have  unknown 
parameters  and  hence  adaptive  control  had  to  be  used  in  both  cases.  The  two  systems 
were  chosen  to  be  linear  with  linear  interconnections,  and  both  systems  were  unstable. 

The  questions  of  interest  are 

(i)  How  do  the  individual  subsystems  stabilize  themselves  when  no 
interconnection  is  present? 

(ii)  How  do  the  interconnections  affect  the  behavior  of  the  two  systems  when  (a) 
there  is  no  communication,  (b)  partial  communication,  and  (c)  complete 
communication  between  them? 

In  the  case  when  interconnection  is  present,  each  subsystem  is  unaware  of  the  signals  of 
theother  system  that  are  affecting  its  output. 

Simulation  studies  carried  out  with  the  two  adaptive  subsystems  decoupled  were  carried 
out  with  sinusoidal  reference  inputs.  While  the  output  errors  converged  to  zero  as 
expected,  the  overshoots  of  the  corresponding  signals  were  5.12  and  2.80  respectively. 
These  were  used  as  benchmark  values  while  evaluating  the  perfonnance  of  the 
interconnected  systems. 

Several  simulations  were  carried  out  assuming  that  the  two  subsystems  ignore  the 
interconnection  and  treat  the  signals  from  the  other  subsystems  as  disturbances.  Since, 
this  corresponds  to  robust  adaptive  control,  none  of  the  signals  converged  to  their  desired 
values.  Further,  in  some  cases  the  overall  system  became  unstable.  This,  in  turn,  indicates 
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that  in  practical  systems  the  external  signal  cannot  be  treated  as  “disturbances”  and  that 
active  control  action  has  to  be  taken  to  compensate  for  them. 

In  the  next  set  of  simulation  studies,  the  desired  (sinusoidal)  outputs  of  the  two  systems 
were  assumed  to  be  common  knowledge,  Hence,  each  subsystem  uses  the  desired  (rather 
than  the  actual)  output  of  the  other  subsystem  in  its  computation  of  the  control  input.  In 
view  of  this,  the  overall  system  became  stable.  However,  the  overshoots  in  the  transient 
case  were  substantially  larger  as  expected. 

In  the  following  simulation  studies  communication  played  a  central  role  in  the  control 
problem.  The  effect  of  both  complete  communication  and  partial  communication  on 
overall  performance  were  studied.  As  stated  in  Section  2,  the  degree  of  communication 
can  be  varied  by  changing  a  threshold  parameter  T  i.e.  the  system  £,  measures  its  own 
output  and  the  error  w/,  -  v,  and  communicates  the  value  y,-  to  the  other  subsystem  when 
\ydi  ~  y\  >  T.  T  =  0  implies  communication  at  every  instant  while  T  =  oo  implies  no 
communication.  It  was  found  that  even  a  small  amount  of  communication  resulted  in  a 
substantial  improvement  in  performance 

Table  1:  The  overshoots  and  the  numbers  of  communication  instants  for  different  values 
of  the  threshold  T  for  two  interconnected  subsystems 


T 

Oy 

03 

Ai 

N 3 

0 

8.35 

4.53 

100000 

100000 

1 

8.56 

4.80 

75 

85 

3 

8.57 

4.90 

23 

13 

4 

9.20 

6.29 

19 

9 

5 

13.28 

9.20 

11 

5 

10 

16.72 

21.48 

6 

4 

OO 

68.55 

57.03 

0 

0 

A  summary  of  the  results  of  the  simulation  studies  are  shown  in  Table  1.  The  Table 
shows  the  overshoots  in  the  outputs  for  different  time-instants  N\  and  A3  at  which 
communication  takes  place.  At  instants  when  a  subsystem  receives  information  from  the 
other,  it  uses  that  information  to  generate  its  control  input.  At  those  instant  where  no 
information  is  received,  it  uses  the  desired  value  of  that  signal  in  its  computations.  The 
Table  1  clearly  indicates  that  substantial  improvement  in  performance  that  can  be 
achieved  by  communicating  at  critical  instants  (in  the  present  case  when  the  actual  value 
at  any  subsystem  deviates  significantly  from  the  desired  value). 


3.2  Simulation  Studies  (Six  Interconnected  Systems) 


Since  our  ultimate  aim  is  to  apply  the  theoretical  results  in  Section  2  to  large 
interconnected  systems,  simulation  studies  similar  to  those  described  in  the  previous  case 
were  also  carried  out  on  a  network  consisting  of  six  subsystems. 
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Each  subsystem  measures  its  own  output  v„  and  its  error  (yj—ya),  and  broadcasts  the 
values  of  y,  to  all  the  other  subsystems  when  the  absolute  value  of  the  error  \y,  -  Vd,\ 
exceeds  a  threshold  Ta.  In  Table  2  the  threshold  T,  the  overshoot  O,  and  the  number  of 
instants  N  during  which  subsystem  X  communicates  with  the  other  is  shown. 

Table  2:  The  overshoots  and  the  numbers  of  communication  instants  corresponding  to  x, 
for  different  values  of  the  threshold  T  for  six  interconnected  subsystems 


T 

Oi 

Ni 

0 

33.36 

100,000 

5 

40.76 

313 

10 

51.05 

108 

20 

140.83 

56 

00 

1025 

0 

The  Table  shows  that  there  is  dramatic  improvement  in  performance  even  with 
communication  at  relatively  few  instants  of  time. 


4.  Conclusions  and  Future  Work 

Prior  to  starting  work  on  this  project  the  PI  had  theoretically  demonstrated  that 
interconnected  subsystems  can  achieve  zero  tracking  errors  without  any  communication 
provided  the  value  of  the  desired  outputs  of  all  the  subsystems  are  common  knowledge. 
The  result  was  both  simple  and  elegant,  and  conceptually  very  appealing.  In  the  spirit  of 
adaptive  control,  it  states  that  when  the  values  of  certain  variables  are  unknown,  their 
desired  values  can  be  used  instead  to  compute  control  inputs.  However,  the  result  had 
been  derived  only  for  a  simple  class  of  systems.  The  first  part  of  the  project  was 
consequently  spent  on  detennining  the  general  classes  of  systems  for  which  this  result  is 
valid. 

Simulation  studies  were  then  carried  out  on  computer  models,  to  determine  how  well 
such  control  algorithms  would  perform  in  applications.  It  was  found  that  the  transient 
errors  of  all  the  subsystems  can  be  substantial  with  reasonable  errors  in  the  parameters 
and  initial  condition  of  the  various  subsystems.  In  view  of  this,  the  PI  decided  to  use 
communication  between  subsystems. 

Partial  communication  between  subsystems  implies  that  each  subsystem  has  knowledge 
of  the  actual  signals  needed  to  compute  the  proper  control  inputs  at  certain  instants  of 
time,  and  has  to  resort  to  prior  infonnation  to  generate  control  inputs  at  other  instants. 
This  gave  rise  to  important  stability  questions  which  were  resolved  in  the  second  stage. 

Once  the  stability  issue  was  decided,  attention  was  focused  on  the  performance  of  the 
overall  system.  To  minimize  communication  costs  while  achieving  a  certain  level  of 
performance,  questions  as  to  when  communication  between  subsystems  should  take  place 
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were  raised.  Simulation  results  indicated  that  significant  improvement  in  perfonnance 
could  be  achieved  by  communicating  at  a  few  critical  instants  of  time.  At  the  end  of  the 
project  optimization  problems  were  being  discussed  related  to  when  and  with  whom  any 
subsystem  should  communicate. 

The  approach  proposed  in  the  report  has  profound  philosophical  as  well  as  practical 
significance  for  the  design  of  intelligent  control  systems.  In  any  control  system,  stability 
and  performance  are  two  objectives  that  are  usually  coupled.  Stability  can  generally  be 
assured  for  restricted  classes  of  systems  under  fairly  strong  assumptions.  On  the  other 
hand,  if  systems  are  optimized,  it  is  very  hard  to  detennine  the  conditions  under  which 
they  will  be  stable.  By  proving  stability  unconditionally  at  the  lower  level,  the  approach 
used  in  this  report  decouples  the  two  problems  and  permits  optimization  at  a  higher  level 
to  be  carried  out  independently. 

There  are  numerous  directions  in  which  the  work  reported  here  can  be  extended.  The 
most  important  of  these  concerns  interconnections  between  subsystems  that  are 
nonlinear.  If  theoretical  results  can  be  derived  in  such  cases  and  implemented  using 
artificial  neural  networks,  it  will  have  a  significant  impact  on  the  design  of  large  scale 
control  systems. 

A  number  of  assumptions  have  been  made  throughout  the  report.  For  the  most  part 
idealized  cases  have  been  considered  and  these  assumptions  need  to  be  relaxed.  Further, 
it  is  assumed  that  communication  between  subsystems  is  instantaneous  and  noise  free. 
The  effect  of  delay  in  communication  is  an  important  question  that  needs  to  be  addressed. 
Finally,  numerous  stochastic  versions  of  the  problems  described  in  the  report  can  also  be 
formulated. 
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Abstract 

The  adaptive  control  of  strictly  decentralized  adaptive  control  systems  has  been  investigated  in  the  past 
and  it  has  been  demonstrated  that,  under  very  general  conditions,  exact  asymptotic  tracking  by  the  different 
subsystems  can  be  achieved  without  any  communication  between  them.  In  this  paper  the  problem  is  discussed 
when  communication  between  the  different  subsystems  is  permitted.  The  problems  considered  range  from  totally 
decentralized  control  to  totally  centralized  control,  with  emphasis  on  partial  communication.  In  all  cases,  the 
problems  can  be  posed  as  ones  related  to  the  stability  of  switching  systems.  The  principal  theoretical  contribution 
of  the  paper  is  the  demonstration  that  the  overall  system  is  globally  stable,  resulting  in  exact  asymptotic  tracking 
by  all  the  subsystems.  Decoupling  stability  and  performance  issues  permits  the  designer  to  focus  on  improving 
the  behavior  of  the  overall  system.  The  principal  practical  contribution  of  the  paper  is  the  demonstration  that 
significant  improvement  in  transient  responses  of  the  subsystems  can  be  achieved  with  communication  at  relatively 
few  instants  of  time. 


1  Introduction 


After  robustness  issues  related  to  adaptive  control  systems  were  resolved  to  a  large  extent  in  the  1980s,  interest  in  the 
field  shifted  to  the  behavior  of  interconnected  adaptive  systems  [1]— [3] .  A  wide  spectrum  of  problems  were  formulated 
in  the  1990s  depending  upon  the  assumptions  made  about  the  subsystems,  the  structure  of  the  interconnections, 
the  nature  of  the  uncertainty,  the  common  knowledge  shared  by  the  controllers,  and  the  communication  permitted 
between  the  subsystems.  As  in  classical  adaptive  control,  convergence  of  the  tracking  errors  of  the  subsystems  to 
zero  in  the  ideal  case,  and  robustness  of  the  overall  system  in  the  presence  of  different  types  of  perturbations  were 
investigated.  Much  of  the  work  reported  was  devoted  to  strictly  decentralized  systems  in  which  no  communication 
between  subsystems  was  permitted.  In  the  Eleventh  Yale  Workshop  on  Adaptive  and  Learning  Systems  [4]  and 
later  in  [5],  the  authors  proved  that  the  overall  adaptive  system  could  be  made  globally  asymptotically  stable  with 
all  tracking  errors  tending  to  zero,  provided  all  the  controllers  are  aware  of  the  desired  trajectories  of  the  other 
subsystems  (i.e.,  there  is  implicit  cooperation  between  the  different  subsystems).  The  same  result  had  also  been 
obtained  earlier  independently  by  Mirkin  [6].  During  the  past  three  years,  the  results  in  [5]  were  extended  to  more 
general  classes  of  systems  by  Narendra  and  Oleng  in  [7], [8].  These  include  subsystems  whose  interconnections  are 
nonlinear,  whose  unknown  transfer  functions  are  positive  real,  and  linear  and  nonlinear  subsystems  whose  outputs 
but  not  state  vectors  are  accessible.  In  all  cases  it  was  shown  that  common  knowledge  of  the  objectives  of  all 
subsystems  is  adequate  to  achieve  exact  model  following. 

In  [4],  the  authors  stated  their  belief  that  communication  between  subsystems  is  essential  for  achieving  desired 
robust  performance  in  complex  interconnected  adaptive  systems,  and  went  on  to  say  that  the  study  of  strictly 
decentralized  control  systems  was  merely  a  precursor  to  the  analysis  of  such  subsystems.  In  this  paper,  adaptive 
control  in  decentralized  systems  with  partial  communication  is  discussed.  Since  communication  is  intermittent,  the 
various  controllers  in  the  overall  system  have  to  generate  their  control  inputs  based  either  on  prior  information,  or 
the  information  received.  This  gives  rise  to  a  class  of  switching  systems  whose  stability  is  investigated  in  this  paper. 
Simulation  studies  are  also  included  to  demonstrate  that  substantial  improvement  in  performance  can  be  achieved 
with  relatively  little  communication  at  judiciously  chosen  instants  of  time. 
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Comment  1:  As  shown  in  the  paper,  while  the  results  for  the  strictly  decentralized  case  are  theoretically  very 
important,  nevertheless  they  are  not  practically  viable.  This  is  because  the  transient  responses  of  the  subsystems  in 
the  absence  of  communication  may  reach  very  large  values  (possibly  of  the  order  of  1025)  before  the  errors  converge 
to  zero,  if  the  initial  parameter  errors  are  large.  In  contrast  to  this,  transient  responses  encountered  with  partial 
communication  are  comparable  to  those  generally  encountered  in  adaptive  systems.  It  should  also  be  mentioned 
that  adaptive  systems  are  nonlinear  systems,  and  even  after  decades  of  work,  efficient  mathematical  tools  do  not 
exist  which  can  predict  accurately  the  transient  performance  that  can  be  expected.  In  view  of  this,  one  can  only 
rely  on  simulation  results  to  justify  the  efficiency  of  communication  for  improving  transient  responses  in  adaptive 
control. 

The  general  problem  of  incorporating  communication  in  control  has  been  addressed  from  various  vantage  points 
by  numerous  authors  [9],  [10].  For  instance,  Hristu  and  Morgansen  [9]  consider  schemes  for  stabilizing  multiple 
coupled  linear  systems  with  a  single  controller  using  output  feedback,  when  the  subsystems  can  only  communicate 
through  a  network.  Walsh  et  al  [10]  have  developed  a  scheme  for  networked  control  systems  in  which  ways  are 
explored  for  assigning  priority  for  network  usage.  During  the  past  few  years  the  effective  use  of  communication  in 
control  has  become  an  active  area  of  research. 

The  problem  explored  in  this  paper  approaches  the  use  of  communication  in  control  from  a  different  perspective. 
Instead  of  a  single  controller,  each  subsystem  S,  has  a  controller  Ct  which,  at  any  instant,  generates  a  control 
input  Ui  regardless  of  whether  or  not  it  receives  any  information  from  the  other  subsystems.  This  results  in  a 
switching  control  system,  since  the  rule  for  the  computation  of  tq  depends  on  the  information  available  to  C\  at  any 
instant.  Also,  the  decisions  concerning  what  to  communicate,  and  when  to  communicate  it,  are  left  to  the  individual 
controllers. 

The  objective  of  the  study  is  to  determine  protocols  for  controllers  to  broadcast  the  values  of  their  outputs  so 
that  all  the  other  subsystems  use  those  values  to  generate  appropriate  inputs  adaptively.  For  different  protocols,  the 
problem  is  to  assure  theoretically  the  stability  of  the  overall  system,  and  study  through  simulations  the  improvement 
in  performance  in  terms  of  the  transient  responses  of  the  individual  subsystems. 

The  paper  is  organized  as  follows:  In  Section  2  the  Strictly  Decentralized  Control  Problem  is  described.  In 
Section  2.1  the  simplest  problem  when  the  interconnections  are  linear  and  the  state  vectors  of  all  the  subsystems  are 
available  to  every  controller  Ct  (i  =  1,2,...,  N )  is  posed,  and  the  proof  of  stability  is  presented  in  Section  2.2.  In 
sections  2. 3-2. 6  successively  more  complex  versions  of  the  problem  are  considered  in  which  either  the  interactions  are 
nonlinear,  or  less  information  concerning  the  other  subsystems  S j(j^i)  is  available  to  each  subsystem  In  all  cases, 
the  input  iq  and  the  changes  needed  to  assure  global  stability  are  stated.  Finally,  in  Section  3,  the  decentralized 
control  problem  with  partial  communication  is  addressed  and  simulation  results  are  presented  in  Section  4. 

Comment  2:  If  there  is  no  communication  between  the  subsystems  £*,  we  have  the  strictly  decentralized  adaptive 
control  problem  treated  in  [4-6].  If  at  every  instant  each  subsystem  £»  broadcasts  to  all  the  others  all  the  relevant 
information  needed  for  control,  we  have  a  problem  that  is  equivalent  to  centralized  control.  Hence,  the  problem  that 
is  of  practical  interest  is  when  communication  between  subsystems  is  intermittent. 

The  principal  theoretical  contribution  of  the  paper  is  the  demonstration  that  the  switching  algorithms  proposed 
for  all  the  controllers  C,  results  in  global  stability  of  the  overall  system.  The  principal  practical  contribution  of  the 
paper  is  the  demonstration  that  significant  improvement  in  the  transient  response  of  the  overall  adaptive  system 
can  be  achieved  with  communication  between  subsystems  at  relatively  few  instants  of  time. 

Comment  3:  Both  discrete-time  and  continuous-time  interconnected  adaptive  systems  have  been  theoretically 
studied.  However,  due  to  space  limitations,  only  theoretical  results  derived  for  continuous-time  systems  are  included 
here.  Also,  simulation  studies  have  been  carried  out  using  both  types  of  systems.  Since  discrete-time  results  are 
simpler  to  interpret,  they  are  included  here. 
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2  Decentralized  Adaptive  Control 


In  this  section,  we  state  several  different  versions  of  the  strictly  decentralized  control  problem.  In  Section  2.1  the 
simplest  case  is  considered  where  all  the  subsystems,  as  well  as  the  interconnections,  are  linear.  For  the  sake  of 
continuity,  and  also  because  it  features  prominently  in  the  following  sections  while  dealing  with  stability  of  systems 
with  partial  communication,  the  proof  of  stability  in  the  above  case  is  included  in  Section  2.2.  In  subsections  2.3 
to  2.6,  more  general  cases  of  strictly  decentralized  control  problems  are  stated.  As  might  be  expected,  the  solutions 
to  these  problems  become  increasingly  more  complex.  Due  to  space  constraints,  detailed  proofs  are  given  in  some 
cases,  and  condensed  versions  of  the  proofs  are  presented  for  the  others.  In  each  case,  it  is  shown  that  the  stability 
of  the  overall  decentralized  system  can  be  assured  even  when  there  is  no  communication  between  the  subsystems. 
This  sets  the  stage  for  the  statement  and  discussion  of  the  principal  problem  of  decentralized  control  with  partial 
communication  in  Section  3. 

2.1  The  Linear  Strictly  Decentralized  Control  Problem 

Problem  1:  A  system  £  consists  of  N  subsystems  Si,  E2,  •  •  •,  Eat  that  are  interconnected.  For  convenience  we 
shall  assume  that  each  subsystem  £.;  has  a  controller  Ci  which  computes  the  control  input  ui  to  £;.  The  subsystems 
Yii  are  described  by  the  equations 

N 

Sj  :  ii(t)  =  AiXi(t)  +  bi  y 

*€{1,2...,  N}  =  fi,  Ui(t)  G  R  is  the  input,  Xi(t)  €  Rni  the  state  of  £;  at  time  t ,  and  the  constant  vectors  bi  are 
known.  The  matrices  A;  G  RniXni  are  assumed  to  be  unknown,  but  it  is  further  assumed  that  constant  vectors 
k*  G  Rn‘  exist  such  that 

Ami  =  Aj  +  bik*T  Vi  G  fl  (2) 

where  Ami  are  asymptotically  stable  matrices.  The  terms  ^  i)  in  equation  (1)  correspond  to  the  pertur¬ 

bations  on  the  subsystem  £ i  due  to  subsystems  £,■  (j  ^  i,j  G  f l).  The  vectors  Uj  G  Rnj  are  assured  to  be  constant 
and  unknown. 

The  N  subsystems  have  N  reference  models  T,mi ,  where  Emj  is  described  by  the  equation 

Syni  •  Xmiik)  —  Ami.Xmi{f)  A  biTi(t)  Vi  G  II  (3) 

where  ry(f)  are  bounded,  piecewise-continuous  reference  inputs  and  xmi(t)  are  the  corresponding  state  vectors  that 
have  to  be  tracked. 

The  strictly  decentralized  control  problem  can  be  stated  as  follows: 

Given  N  subsystems  described  by  equation(l),  and  N  reference  models  described  by  equation  (3),  and  assuming 
that  controller  Ci  of  Et  has  access  only  to  its  own  state  Xi(t)  (i  G  II),  can  it  generate  an  input  *q(t)  such  that  all 
the  signals  in  the  system  are  bounded,  and 

lim  \\xi(t)  -  xmi{t)\\  =  0  (4) 

t— >00 

Comment  4:  If  the  state  Xj(t)  of  £j  is  accessible  to  Eit  the  problem  reduces  to  a  standard  centralized  adaptive 
control  problem.  Ui(t)  would  then  include  a  component  —lij(t)xj{t)  to  compensate  for  the  perturbations,  where 
hj(t)  is  an  estimate  of  ll:]  and  is  determined  on-line  using  standard  adaptive  techniques.  The  principal  difficulty 
arises  because  both  lij  and  Xj(t)  are  unknown  to  G{. 

2.2  Proof  of  Stability  (decentralized  case) 

In  [5,6]  it  was  shown  that  if  all  the  subsystems  use  the  (known)  desired  values  of  the  outputs  of  the  other  subsystems 
in  place  of  their  (unknown)  true  values,  the  overall  system  will  be  stable  and  all  the  tracking  errors  will  tend  to  zero. 
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The  proof  given  below  follows  that  in  [5] . 

If  xmj  is  used  in  place  of  Xj  in  the  generation  of  the  control  input  Uj(t)  of  we  have  terms  of  the  form 

N  N 

^  (  bi(ki  kr )  Xj  and  ^  (5) 

i—l 

in  the  error  equations,  if  we  choose  the  control  input  as 

N 

Ui(t)  =  rj(t)  +  kj Xi(t)  -  jieJ Pjbj  -  ^  (6) 

where  ej  =  Xj  —  xmj  is  the  state  error  of  Pj  is  a  symmetric  positive  definite  matrix  satisfying  the  Lyapunov 
equation  A^Pj  +  PjAmj  =  —Qi,  where  Qj  is  any  symmetric  positive  definite  matrix,  and  kj{t)  is  a  vector  of 
adjustable  gains. 

The  differential  equation  governing  the  behavior  of  ej(t)  is  given  by 

N 

€j  =  ArnjC7  -T  bjkj  Xj  7i c,-  Pjbj  T  bj  ^  )  \^ij U/  bjjXm^  (7) 


where  kj  =  kj  —  k*. 

The  adaptive  laws  for  adjusting  kj  and  Ijj  are  chosen  as 

kj  =  kj  =  —eJPjbiXi 

and 


j  =  —  /■■  =:  —  pk  P  b-X 


(j  ^  i ) 


where  lij  =  l ij  —  lij. 


Choosing  the  Lyapunov  function  candidate 

N  N  N 

V{e-i,  ki,  kj )  =  ^  ei  Piei  +  kiki-\-  ^  ^  l^li 


i=  1 

the  time  derivative  of  V  along  any  trajectory  is 

N 


i=l  j=l,j^i 


or 


N  N 

V  =  ^2[~ef  Qtej  -  2jj(ef  Pjbj)2}  +J2  2ei  pibill 

i=l  i—l  j=l,j^i 


N  N  N 

V  <  y^[-Am»n(Qi)||ei||2  -  2q ijelPibi)2]  +  ^  2 ef  PM^ej 

*= 1  i=1 


It  can  be  shown  that  if  7*  is  sufficiently  large,  i.e., 


li>l(N~1)  max(  JhjJL  ) 

^  0  '^miny^c  j ) 


(8) 

(9) 


(10) 


(11) 


(12) 


(13) 


where  Xmin(Qj)  is  the  minimum  eigenvalue  of  Qj,  V  is  negative  semi-definite  so  that  all  the  output  and  parameter 
errors  are  bounded. 


Using  standard  arguments  of  adaptive  control,  it  can  be  shown  that  all  the  output  errors  ej  tend  to  zero  asymp¬ 
totically  with  time. 
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Comment  5:  The  Lyapunov  function  (10)  used  to  prove  stability  is  quadratic  in  the  output  errors  e*  as  well  as  the 
parameter  errors  hi  and  Uj.  It  is  also  worth  pointing  out  that  (since  the  system  is  decentralized)  it  contains  only 
terms  of  the  form  ef  Pi.ei  and  does  not  contain  the  cross  terms  e^ej,  i.e.,  it  is  block  diagonal  in  the  output  errors. 
The  critical  role  played  by  the  feedback  control  input  component  — jief  Pibi  to  the  ith  subsystem  E,  in  equation  (6) 
towards  overall  system  stability  is  also  evident  from  the  expression  for  V  in  equation  (12). 

As  stated  in  Comment  2,  the  principal  difficulty  in  controlling  the  system  adaptively  arises  due  to  the  fact  that 
both  lij  and  Xj(t)  are  unknown.  To  compensate  for  the  disturbing  signal  ifjXj,  controller  Ct  has  to  use  a  signal 
component  — hjXmj  in  the  control  input  iq(t)  to  E j,  and  at  the  same  time  modify  the  adaptive  law  for  adjusting  the 
parameter  estimates  to 

lij  =  PibiXmj  (14) 

This  ensures  that  terms  of  the  form  ej PibilJjXmj  do  not  appear  in  V,  which  is  consequently  negative  semi-definite. 

Comment  6:  By  making  the  individual  subsystems  Ej  to  be  sufficiently  stable,  the  overall  system  is  also  made 
stable  even  in  the  presence  of  the  interconnections  between  the  subsystems.  This  is  assured  by  the  existence  of  a 
block-diagonal  Lyapunov  function  for  the  latter. 


2.3  Extensions  of  the  strictly  Decentralized  Control  Problem 

Figure  1  shows  the  different  extensions  of  the  strictly  decentralized  control  problem  that  have  been  investigated  in 
[7]  and  [8].  Such  problems  fall  broadly  into  two  categories:  (i)  those  in  which  the  state  vector  of  the  subsystems 
are  accessible,  and  (ii)  those  in  which  only  the  outputs  of  the  subsystems  are  accessible.  In  the  first  category  both 
linear  and  nonlinear  interconnections  have  been  considered  and  in  the  second  category  subsystems  with  different 
relative  degrees  and  having  either  the  feedback  linearization  form  or  the  normal  form  have  been  investigated.  Due 
to  space  limitations,  we  address  only  some  of  the  problems  in  detail.  However,  in  all  cases  it  has  been  shown  in 
[7,8]  that  exact  output  tracking  by  all  the  subsystems  can  be  achieved  by  using  either  the  desired  state  variables  or 
desired  outputs  in  place  of  the  actual  values  in  both  the  control  inputs  to  the  subsystems  and  in  the  adaptive  laws 
for  adjusting  the  unknown  parameters. 


Figure  1  goes  here. 


2.4  Nonlinear  Interconnections 


Problem  2:  The  first  extension  of  decentralized  controls  treated  in  Problem  1  is  to  systems  where  the  interconnec¬ 
tions  are  nonlinear.  Ej  in  this  case  is  described  by 


•  &i  —  -A-iXi  +  bikj  Xi  -\-  bi 


N 


y  i  fij{xj)pui 


where  Aj,  bi,  hi  are  the  same  as  before,  but  /),■  ( • )  :  Rnj  — »  R  are  known  nonlinear  functions  of  the  state  Xj  of  E j 
(j  €  f 2).  The  state  variables  Xj(t)  are  not  accessible  to  the  controllers  Cj  (i  ^  j),  and  the  objectives  are  the  same 
as  in  Problem  1. 
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The  case  when  the  function  /y  (•)  are  globally  Lipschitz  is  a  simple  one  and  it  has  been  demonstrated  that  results 
identical  to  those  obtained  in  the  linear  case  can  be  derived  if  components  of  the  form  -  J2  f‘j(xmj)  are  used  in 
Ui .  When  the  interconnections  are  not  globally  Lipschitz  but  the  functions  are  assumed  to  be  bounded  by  a 
polynomial  whose  order  p  is  known,  the  condition  may  be  written  as 


v 

I  fijixj)  =  \fij(xmj  +  &j)  ~  fij{xmj)\  T  £ijk \\ej  ||  ' 

fc= 1 


(15) 


where  a  re  constants. 

From  inequality  (15),  we  can  deduce  that  positive  constants  t;tk  exist  such  that 


N  p  N  p 

E  Ei/bfe)-/b(^)i2<  E  E^ini2* 


j=l  *=1 


1=1,  fe=1 


If  the  input  iq  to  E,  (z  G  fl)  is  chosen  as 
Ui  =  n  +  kjx.i  -  EEjV-*  foo{xrnj)  ~  li(ef  PA)[1  +  (ef Piei)p^1)] 

The  resulting  error  equation  of  the  zth  subsystem  E,  has  the  form 

e*  =  A.miei  +  bikfxi  +  b,  Y,f=i,jjti[fij(xj)  -  /ij(»mj)]  ~  lAeJ  Plbi[l  +  (ef  Piei)^1] 

If  the  parameters  are  adjusted  as 

p 

h  =  —eJPibiXi  E(ef^ei)fc_1 

fc=l 

and  a  Lyapunov  function  candidate  is  chosen  as 

AT  p 


V  =  YJ[kfh  +  Y,^P^)h 


i= 1  fe=l 

the  time  derivative  along  any  trajectory  can  then  be  shown  to  satisfy  the  equation 

N  p  N  p  N 

V  =  EEbMefAey-'efQ^]  +  EE  eJ  pA  E^lOo)  -  /ij(^mj)] 

*=1  fc=l  Z=1  fc— 1  J=1 

A/-  p 


EE  k^/i(eiPibi)2  (ej  Piei)k  1[1  +  (ej  Pie.i)p  1] 


(16) 


(17) 


(18) 


i—1  k— 1 


If  7 i  is  chosen  as 


7 i  >  max[| 


2 (N  -  l)p£ik 


k  '[XminiPiW-^miniQi) 

V  can  be  shown  to  be  negative  semidefinite.  This  also  implies  that  there  exist  positive  constants  r/ih  such  that 

N  p 

b<EE-^  iNi2fc<° 

i—l  k—1 


(19) 


(20) 


Once  again,  by  previous  arguments,  it  follows  that  the  errors  ei(t)  tend  to  zero  asymptotically. 


2.5  Subsystems  With  Relative  Degree  n*  =  1 

Problem  3:  An  interesting  extension  of  the  decentralized  control  problem  is  to  subsystems  whose  outputs,  rather 
than  state  variables,  affect  the  performance  of  other  subsystems.  In  this  problem  we  further  assume  that  the  transfer 
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functions  of  all  the  subsystems  have  unity  relative  degrees  and  that  the  corresponding  reference  models  have  transfer 
functions  that  are  strictly  positive  real  (SPR).  £ *  in  this  case  has  the  form 

N 

•  Xi  —  AjXi  T  bflli  T  ^  ^  (yj)\  (21) 

J=1 

Vi  =  hf  Xi 

where  {hf,  A*,  b{}  are  observable  and  controllable,  and  fl3  (.)  are  scalar  functions  of  their  arguments.  The  signals  to 
be  tracked  (i.e.,  the  reference  signals)  are  assumed  to  be  generated  by  reference  models  described  by 


—  An 


Umi  —  Cmi%mi 


(22) 


with  strictly  positive  real  transfer  functions 


hhrmC'S)  —  kmi 


Rmi  (^) 


As  in  standard  adaptive  control  (as  well  as  the  problems  treated  earlier),  the  input  of  E*  is  chosen  as 


N 


where 


and  6i  is  defined  later  in  equation  (25). 


=  Qj  Vi-  E  A?  ( Vmj )  -  7 i9i  (e* ) 
T  r  (!)  (2) i 

Vi  =  [ri,v\  ,yi,v\ 
of  =  [ki,  9o i)  ii  02 »]) 


The  terms  — fij{ymj )  compensate  for  the  interaction  terms  fij{yf),  while  gfti)  is  a  nonlinear  feedback  term  that 
depends  upon  the  output  error  and  plays  an  important  role  in  the  stability  analysis  of  the  overall  system. 

The  variables  and  vf'1  are  defined  by  the  differential  equations 

Fi  :  f'h  =  +  kefuji  -  laigfci)  (23) 

iff1  =  A  ipf )  +  kyi 

where  A*  £  jRfai-Dxbu-i)  and  is  stable,  and  U  £  IR™i_1  and  A,,^  is  controllable.  Adjoining  and  to  Xi  we 
obtain  an  extended  vector  x,-,  that  is  the  state  vector  of  the  system  £,:  which  includes  the  system  £,;  and  the  filters 
Fi. 

Xi  =  [xi,  v[2'1]  is  described  by  the  differential  equation 

N 

A  =  AmrHXi  +  bmni[4>fwi-'yig(ei)  +  k*ri]+bi  E  [fij(yj)  ~ 

3=h 

Vi  =  kmn.Xi  (24) 

where  bi  =  [64,0,0]T  and  hfn.[sl  -  Amn\~rbmni  is  SPR. 


Defining  ej  =  27  —  xmni  and  fa  =  9i  —  9*,  we  obtain  the  error  equations 


e* 


<7 


T  brnni  [ffvi 

hT  e 


N 

7i5»(e*)]  +  E  [/«(%)  “  fiAVmj)\ 

i=i  jA* 


(25) 
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From  equation  (25)  it  is  seen  that  the  error  equations  of  the  overall  system  consist  of  the  error  equations  of  the  N 
subsystems  together  with  the  nonlinear  interconnections  between  the  subsystems.  Choosing  the  Lyapunov  function 
candidate 

N 

v  =  ^[ej  Piei  +  4>J  (j>i\ 

i—1 

where  P*  is  the  positive  definite  matrix  solution  to  the  Lyapunov  equation 

Amm^i  +  PiAmm  =  ~Qi  Qi  =  Qj  >  0 
and  adjusting  the  parameter  error  vector  using  the  adaptive  law 

bi  =  Gey 


the  time  derivative  of  V  along  any  trajectory  can  be  expressed  as 

N  N  N 

v  =  ^[-efQiei-2ei5i(ei)]  +  ^  pMfij (Vj)  ~  fijiVmj)] 

i=l  *=1 

Since  yj  =  ymj  +  ej,  Vj  G  f 2,  and  since  ymj  is  bounded,  we  have  the  following  relation  and  inequality: 
fij  ( +  Umj )  jijiVmj)  |  =  0  if  €j  =  0,  Vj  G  12 


and 

I  +  ymj )  -  fij  {ymj)  I  <  Fji(ej)  with  Fji( 0)  =  0 


Following  along  the  same  lines  as  before,  it  can  be  shown  that  there  exist  7 and  g(ei)  such  that 


N 

2^ei9i(ei)  >  (  IIPAf  £  Fji(ei) 

A min\yCi  ) 


j=i,j^i 


(26) 


(27) 

(28) 


From  the  above  discussion  it  follows  that  y,  G  L°°  and  e,  G  L2,  so  that  it  follows  by  Barbalat’s  lemma  that 

lim  [yi  -  2/mi]  =0  Vz  G  O. 


2.6  Relative  Degree  n*  >  1 


The  most  general  strictly  decentralized  control  problem  that  has  been  investgatecl  includes  subsystems  whose  relative 
degrees  are  greater  than  one,  and  where  only  the  desired  values  of  their  outputs  are  known.  Two  cases  have  been 
investigated  in  this  context.  In  view  of  space  limitations,  the  details  of  the  derivations  are  not  included  here. 


Case  (i):  The  subsystem  X,;  is  defined  by  the  state  equations 

LI %  .  Xu  —  Xi2 
%i2  —  %i3 

Xini  =  Ui  +  J2fij(Vj) 
yi  =  xn 

It  is  assumed  that  the  state  variables  Xn,  272,  • . . ,  Xini  are  not  accessible,  and  that  only  Xu  is  accessible  to  controller 
Ci. 

In  the  approach  used  for  this  problem  the  state  Xj  of  X;  is  estimated  using  an  observer  as  Xj,  and  the  input  it* 
is  chosen  as 

u,  =  ^  'jZj ■.  fij  (ymj)  +  (a  linear  combination  of 

Xj,  Zin,  Zin- 1  and  derivatives  of  ymi ) 
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where  Zjk  are  appropriately  defined  auxiliary  error  variables  with  zn  as  the  output  error.  Using  a  quadratic  Lyapunov 
function 


k 


for  each  subsystem,  it  can  be  shown  that  V 

Ei  -KiPfll  +  wi2  Efc  zik\  <  °- 


Ei  Vm  is  a  Lyapunov  function  of  the  overall  system  with  V  < 


been  obtained  for  interconnected  systems  where  each  subsystem  E,  can  be 

xn  =  Xi2  +  aaYjjfij{Vj) 
xi2  =  xa  +  ai2Ej  ffjiVj) 

XiP  =  xip-i  +  dip  Ej  ffj {Vj)  +  hi Ui 

Xin  =  ®in  Ej  fijiVj')  biqUi 

2/1  =  ar*i 

where  a*  =  [a,i,a,;2,...,ain]T  and  b ,  =  [ba,  bi2, . . . ,  biq)T  are  unknown,  the  functions  Uj  =  [fij,  fij,  ■  ■  ■ ,  fijV  are 
known,  the  signs  of  bjj  are  known  and  the  zero  dynamics  of  E,  is  exponentially  stable  for  i  G  Cl. 


Case  (ii):  Similar  results  have  also 
expressed  in  the  normal  form 


Using  standard  procedures,  the  state  vector  Xi  is  estimated  as  Xi  and  the  input  Ui  is  chosen  using  the  certainty 
equivalence  principle  as  a  function  of  the  estimates  6q,  bi  and  a  linear  combination  of  x,,  the  auxiliary  variables  Zin, 
Zin- 1,  and  the  derivatives  of  the  desired  signal  ymi-  For  the  above  system,  a  Lyapunov  function  V  that  is  quadratic 
in  both  output  errors  and  parameter  errors  can  be  shown  to  exist.  Perhaps  more  relevant  to  the  point  is  that  if  the 
input  and  the  adaptive  law  are  modified  as  in  Problem  1  depending  upon  the  information  available,  V  is  a  Lyapunov 
function  and  hence  assures  the  stability  of  the  overall  system. 


3  Adaptive  Control  with  Communication 


In  Section  2,  different  versions  of  the  strictly  decentralized  problem  were  presented  and  in  each  case  it  was  shown 
that  control  inputs  could  be  generated  based  on  desired  rather  than  actual  values  of  the  output  to  control  the 
system  adaptively.  If  communication  between  subsystems  is  permitted,  an  extreme  case  would  correspond  to  E j 
communicating  with  E,  at  every  instant  the  value  of  Xj(t).  In  this  case,  the  system  is  no  longer  decentralized  and 
the  results  are  identical  to  those  with  a  centralized  controller  (except  that  control  to  subsystem  E»  is  implemented 
by  controller  C\). 

The  problem  therefore  is  to  determine  when  any  subsystem  should  communicate  with  another,  and  precisely 
what  information  it  should  communicate.  We  shall  assume  that  in  all  cases  the  information  communicated  by  Ej  to 
Ei  at  any  instant  t  would  transform  the  problem  to  one  of  standard  adaptive  control  (for  example  Xj  (t)  in  Problem 
1).  Further,  since  we  are  interested  in  both  discrete  and  continuous-time  systems,  communication  can  be  at  finite 
instants  or  over  finite  intervals. 

Comment  7:  The  decentralized  adaptive  control  problem  with  partial  communication  has  been  studied  extensively 
by  the  authors  and  numerous  protocols  for  communication  have  been  generated  which  will  be  discussed  in  future 
papers.  In  this  paper,  it  is  assumed  that  all  the  subsystems  E,  are  aware  of  the  desired  outputs  of  the  other 
subsystems  E j  (j  ^  i),  and  that  communication  is  primarily  used  to  improve  the  transient  responses  of  all  the 
subsystems. 


3.1  Centralized  Control 

As  stated  above,  if  at  every  instant,  all  subsystems  are  free  to  communicate  their  outputs  to  the  other  subsystems, 
the  problem  ceases  to  be  one  of  decentralized  control.  Controller  C1,;  would  use  a  component  —tfjXj  to  compensate 
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for  the  disturbing  signal  ifj  Xj,  and  adjust  the  estimate  adaptively  as  in  standard  adaptive  control.  This  would 
result  in  the  control  input 


N 

Uj  (?)  —  T'j  (tj  T  k.i  Xi{t^  Pi^i  ^  ^  lij^j 


and  the  adaptation  laws 

lij  lij  c.j  PibiXj  ( j  y?  '/') 

and  the  quadratic  Lyapunov  function  (10)  will  assure  the  stability  of  the  system  E. 


(29) 


(30) 


3.2  Adaptive  Control  with  Partial  Communication 

In  practice,  due  to  the  cost  associated  with  communication,  it  is  desirable  to  keep  the  latter  to  a  minimum,  while 
assuring  satisfactory  performance.  This  raises  several  questions  related  to  adaptive  control  with  partial  communica¬ 
tion.  Assuming  that  subsystem  E.;  receives  information  concerning  Xj{i)  from  E j  at  instant  t ,  and  at  the  same  time 
has  knowledge  of  xmj  ( t ) ,  how  should  Ci  use  the  information  to  control  the  system?  How  will  this  affect  overall  sys¬ 
tem  stability  and  performance?  The  answers  to  these  questions  will  in  turn  determine  when  E j  should  communicate 
to  E,;  information  concerning  Xj{t). 


3.2.1  A  Switching  Controller 

The  controller  C,;  of  E^  has  at  every  instant  t  knowledge  of  only  xmj(t )  in  the  absence  of  communication,  and  both 
Xj(t)  and  xmj{i)  if  information  is  received  from  E?-.  It  has  been  shown  in  the  preceding  section  that  using  either 
Xj(t)  or  xmj{t)  and  the  corresponding  adaptive  laws  for  adjusting  the  parameter  estimates  lij{t),  global  stability  can 
be  assured.  Since  Cj  has  no  other  recourse  but  to  use  xmj(t)  when  there  is  no  communication,  the  resulting  control 
in  the  presence  of  partial  communication  can  be  considered  as  switching  control  between  two  different  strategies. 


3.2.2  A  Common  Quadratic  Lyapunov  Function 

In  the  preceding  section  it  was  shown  that  the  quadratic  function  V  in  equation  (10)  is  a  Lyapunov  function  for 
E  if  the  feedback  control  m  in  (6)  and  adaptive  laws  (9)  are  used  when  only  xmj(t)  is  accessible  to  C,.  The  same 
function  is  also  a  Lyapunov  function  for  E  if  the  input  it,(f)  given  in  equation  (29)  and  the  adaptive  law  given  in 
equation  (30)  are  used  when  Xj(t)  is  available  to  C\  (i  y?  j).  This  implies  that  V  given  in  equation  (10)  is  a  Common 
Quadratic  Lyapunov  Function  (CQLF)  for  the  overall  switching  system  and  the  system  will  be  stable  for  arbitrary 
switching  between  the  two  strategies.  Further,  at  those  instants  where  Xj[t)  is  available,  Ci  can  use  any  convex 
combination  of  Xj  (?)  and  xmj  (?)  in  the  control  input  and  the  adaptive  laws,  while  retaining  stability. 

If  we  examine  the  proof  of  stability  of  all  the  strictly  decentralized  control  problems  treated  in  Section  2,  it  is 
evident  that  a  change  in  the  adaptive  laws  based  on  actual  or  desired  values  of  outputs  and  a  change  in  the  control 
input  is  needed  to  assure  that  a  positive  definite  function  V  is  indeed  a  Lyapunov  function  for  the  problem.  If  the 
actual  values,  rather  than  the  desired  values  are  used  both  in  the  computation  of  the  inputs  as  well  as  the  adaptive 
laws,  V  continues  to  be  a  Lyapunov  function  for  the  modified  system.  Hence,  all  the  systems  considered  in  Section 
2  are  globally  stable  with  partial  communication. 

The  above  comments  imply  that  the  existence  of  a  CQLF  decouples  completely  the  problem  of  stability  from 
that  of  performance.  Since  stability  is  assured,  the  designer  is  free  to  choose  how  the  information  concerning  Xj(t) 
is  to  be  used.  Numerous  strategies  have  been  proposed  to  improve  performance,  but  due  to  space  limitations  we 
confine  our  attention  to  the  specific  case  of  Problem  1.  Also,  as  mentioned  earlier,  since  no  analytical  methods  exist 
for  estimating  transient  behavior,  simulation  results  are  provided  to  demonstrate  improvement  in  performance  with 
communic  at  ion . 
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4  Simulation  Results 


Simulation  studies  illustrating  the  effect  of  communications  on  the  performance  of  a  decentralized  adaptive  system 
have  been  carried  out  on  both  discrete  time  and  continuous  time  systems.  For  ease  of  explanation  and  clarity  of 
presentation,  all  simulation  experiments  presented  here  deal  with  discrete-time  systems.  While  there  are  essential 
differences  between  continuous-time  and  discrete-time  adaptive  systems,  the  simulation  results  described  in  this 
section  are  very  similar  to  those  observed  in  continuous-time  case,  where  communication  is  not  at  an  instant  but 
over  an  interval  of  time. 

We  consider  two  interconnected  systems  in  this  section.  The  first  contains  only  two  subsystems,  both  of  which 
are  of  second  order.  The  second,  discussed  in  Section  4.2,  contains  six  subsystems  of  second  order. 


4.1  Two  Interconnected  Second  Order  Systems 


A  decentralized  adaptive  control  system  consists  of  two  subsystems  £4  and  E2.  The  two  subsystems  are  respectively 
described  by  the  equations 


Ei  : 

xi(fc+l)  =  — 0.9a;i(A:)  +  0.5a;2(fc)  +  ai3a;3(fc)  +  l.Orti(fc) 
X2(k+1)  =  0.5xi(k)  —  0.25x2(k) 


and 

S2  : 

X3(fc+1)  =  — 0.9x3(fc)  +  0.5a;4(fc)  +  a3ia:i(fc)  +  2.0tt2(fc) 

xi(k  +  l)  =  0.5a,’3(fc)  —  0.25x4(/c) 

It  can  be  seen  that  the  coefficients  of  the  interconnection  terms  are  <24 3  (for  Ei)  and  <234  (for  E2)  respectively.  Further, 
it  can  also  be  verified  that  the  uncoupled  subsystems  ( i.e .,  with  0:13  =  031  =  0)  are  unstable.  All  parameters  of  the 
two  subsystems  (including  the  local  subsystem  parameters  as  well  as  the  coefficients  of  the  interconnection  terms) 
are  assumed  to  be  unknown. 


A  series  of  baseline  experiments  were  first  performed  for  comparison  purposes.  First,  the  two  systems  were 
completely  decoupled  by  setting  ct13  and  031  to  be  zero.  Linear  adaptive  control  (with  recursive  least  squares 
adaptive  laws  and  a  step  size  of  0.5)  was  used  to  control  the  two  subsystems  to  follow  sinusoidal  reference  trajectories 
xmi (k)  =  5.0sin(^^)  and  xm3 (k)  =  —  2.5sin(^£).  The  adaptation  was  continued  for  a  sufficiently  long  time  (i.e., 
100,000  time  steps).  It  was  found,  as  expected  that,  the  errors  converged  to  zero  with  maximum  overshoots  O4  =  5.12 
and  O3  =  2.80  in  x±  and  X3  respectively. 

In  the  second  experiment,  coupling  was  assumed  to  exist  only  one  way  from  £4  to  E2  with  <243  =  0  and 
a31  =  —1.15.  This  implies  that  E4  is  unaffected  by  E2  but  the  latter  is  affected  by  the  output  of  E4.  However,  no 
attempts  were  made  to  compensate  for  this  coupling  and  both  subsystems  were  adaptively  controlled  as  if  they  were 
decoupled  from  each  other.  It  was  found  that  the  control  error  e\  of  X\  still  converged  to  zero  with  0\  =  5.12  (as 
expected,  since  E4  was  decoupled).  However,  since  no  attempt  was  made  to  compensate  for  the  “disturbance  term” 
I31X1,  the  error  e3  did  not  converge  to  zero  and  the  overshoot  O3  was  observed  to  be  12.613.  This  shows  that  ignoring 
the  coupling  as  an  uncompensated  disturbance  results  in  very  poor  performance.  If,  however,  E2  compensates  for 
the  one-way  coupling  by  incorporating  corresponding  terms  in  the  identification  model,  adaptive  law,  and  control 
law  (but  uses  xmi  instead  of  x\,  i.e.,  assumes  no  communication),  e3  did  indeed  converge  to  zero  and  the  value  of  O3 
was  observed  to  be  7.20.  This  demonstrates  that  exact  tracking  is  possible  in  this  case  even  without  communication 
by  substituting  the  desired  values  instead  of  the  actual  ones.  If  full  communication  from  E4  to  E2  was  assumed  and 
E2  used  the  actual  values  of  X\  (not  its  desired  value  xmi)  in  its  control  strategy,  the  control  error  e3  as  expected 
converged  to  zero  with  O3  =  5.32.  Hence,  in  this  case,  communication  did  improve  the  overshoot.  However,  the 
improvement  was  not  very  significant,  presumably  because  Xi  was  most  of  the  time  very  close  to  xmi  since  E4  is 
not  affected  by  E2. 

In  the  third  set  of  experiments,  two-way  coupling  was  assumed  between  E4  and  E2  with  <243  =  1.15  and  <234  = 
—  1.15.  Both  subsystems  were  assumed  to  employ  a  selective  communication  policy  where  they  would  communicate 


22 


their  local  states  to  the  remote  subsystem  if  the  latter  deviated  from  the  desired  value  by  more  than  or  equal  to  a 
threshold  T .  It  can  be  easily  seen  that  by  varying  the  value  of  this  threshold  T,  the  amount  of  communication  between 
the  subsystems  can  be  changed.  For  example,  if  T  =  0,  the  situation  corresponds  to  complete  communication  at 
every  instant.  T  =  oo  corresponds  to  the  case  of  no  communication.  In  the  intermediate  cases,  higher  values  T 
generally  correspond  to  reduced  number  of  instants  of  communications.  It  was  assumed  that  each  subsystem  would 
use  the  actual  values  of  the  remote  states  when  such  actual  values  were  available  (through  communication).  At  all 
other  instants  when  there  was  no  communication  and  the  actual  values  of  the  remote  states  were  not  available,  they 
would  use  the  desired  values  in  place  of  the  actual  states.  Table  1  summarizes  the  overshoots  0\  and  O3  as  well  as 
the  number  of  instants  Ni  and  N3  during  which  communication  took  place  between  Si  and  £2  during  the  entire 
run  of  100,000  time  steps,  for  different  values  of  T. 


T 

Ox 

o3 

Nx 

n3 

0 

8.35 

4.53 

100000 

100000 

1 

8.56 

4.80 

75 

85 

3 

8.57 

4.90 

23 

13 

4 

9.20 

6.29 

19 

9 

5 

13.28 

9.20 

11 

5 

10 

16.72 

21.48 

6 

4 

00 

68.55 

57.03 

0 

0 

Table  1:  The  overshoots  and  the  numbers  of  communication  instants  for  different  values  of  the  threshold  T  for  two 
interconnected  subsystems 

It  can  be  seen  from  Table  1  that  even  a  small  amount  of  communication  between  the  subsystems  improves  their 
performance  substantially.  For  example,  a  threshold  value  of  5  results  in  about  twice  the  overshoot  as  compared  to 
full  communication  with  only  about  0.01%  of  the  communication.  At  the  same  time,  it  results  in  less  than  20%  of 
the  overshoot  observed  with  no  communication  (i.  e.,  when  T  =  00). 

In  order  to  indicate  when  such  communication  took  place,  Figure  2  plots  the  two  control  errors  (i.e.,  ei  and 
63)  and  the  corresponding  communication  indicator  signals.  The  latter  are  represented  by  binary  signals  which  are 
0  when  no  communication  occurs  and  1  when  a  communication  takes  place.  It  can  be  seen  that  the  few  instants 
of  communication  are  all  clustered  during  the  initial  transient  phase  when  the  control  errors  have  relatively  large 
magnitudes. 

Numerous  experiments  were  conducted  for  different  cases  corresponding  to  stable  and  unstable  decoupled  plants 
as  well  as  stable  and  unstable  interconnections.  It  was  generally  observed  that  the  effects  of  selective  communication 
were  more  significant  when  either  the  decoupled  plant  or  the  interconnections  were  unstable.  Similar  observations 
were  also  made  when  the  control  objective  was  regulation  (i.e.,  following  constant  desired  states)  rather  than 
following  sinusoidal  tracking  signals. 


4.2  Results  with  Six  Interconnected  Second  Order  Systems 

To  determine  the  scalability  of  the  method  as  well  as  the  results  reported  in  the  previous  subsection,  simulation 
experiments  were  also  conducted  on  a  larger-scale  system  consisting  of  six  interconnected  second  order  subsystems. 

The  six  subsystems  are  described  by  the  equations: 

Si 

x\ (k  +  1)  =  0.2xi  (k)  +  1.0x2(k)  +  0.5x3(/c)  +  0.5x5(£;)  +  0.5a,’7  (k)  +  0.5xg  (k)  +  0.5xn(fc)  +  l.Oiti(fc) 

X2(k+1)  =  0.2xi(fc)  +  0.5x’2(fc) 
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S2 

£3  (k  +  1)  =  — 0.5x3(fc)  —  0.5x4(fc)  +  0.4xi(fc)  +  0.4x5(fc)  +  0.4x’7(fc)  +  0.4xg(k)  +  0.4xn(/c)  +  2.0u2(k) 

x4(fc  +  1)  =  0.5x3(fc)  —  0.25x4(fc) 


S3 

£5  (k  +  1)  =  0.2£5(fc)  +  l.Oxe(fc)  +  0.5xi(fe)  +  0.5x3(fc)  +  0.5£7  (k)  +  0.5xg  (k)  +  0.5xn(/c)  +  l.Ous(k) 

xe(k+l)  =  0.2x5(fc)  +  0.5xe(k) 


S4 

£7  (k  +  1)  =  — 0.5£7(fc)  —  0.5xs(fc)  +  0.4£i  (k)  +  0.4x3  (k)  +  0.4x5  (k)  +  0.4xg(k)  +  0.4xn(k)  +  2.0u4(k) 

x§(k  +  1)  =  0.5x7(fc)  —  0.25xs(fc) 


S5 

Xg(k  +1)  =  0.2xg(fc)  +  l.Oxio(fc)  +  0.5xi(fc)  +  0.5x3  (k)  +  0.5xs  (k)  +  0.5x7  (k)  +  0.5xn(fc)  +  1.0u5(fe) 

£io(^  +  l)  =  0.2xg(fc)  +  0.5x’io(fc) 


S6 

Xn(fc  +  1)  =  — 0.5xn(/c)  —  0.5xi2(/c)  +  0.4xi(fc)  +  0.4x3(fc)  +  0.4x5(fc)  +  0.4x7(fc)  +  0.4xg(fc)  +  2.0  ue(k) 

xi2(fc  +  l)  =  0.5xn(fc)  —  0.25xi2(fc) 

As  with  two  interconnected  systems,  each  of  the  six  subsystems  in  this  case  was  assumed  to  communicate  its 
state  to  the  other  subsystems  when  the  latter  deviates  from  its  desired  value  by  more  than  a  threshold  T.  Each 
subsystem  is  assumed  to  employ  an  adaptive  control  scheme  using  remote  states  when  available  and  the  desired 
values  of  the  remote  states  when  the  actual  values  are  not  available.  As  before  T  =  0  corresponds  to  complete 
communication  at  every  instant,  and  T  =  00  corresponds  to  strictly  decentralized  control. 

Due  to  space  limitations,  we  present  in  the  following  table  only  the  results  for  one  of  the  states  Xi.  In  particular, 
we  present  both  0\  (the  maximum  overshoot  in  Xi)  and  IVi  (the  number  of  instants  Si  receives  communication 
from  the  other  subsystems)  as  function  of  the  threshold  T. 


T 

0 1 

N\ 

0 

33.36 

100,000 

5 

40.76 

313 

10 

51.05 

108 

20 

140.83 

56 

00 

1025 

0 

Table  2:  The  overshoots  and  the  numbers  of  communication  instants  corresponding  to  Xi  for  different  values  of  the 
threshold  T  for  six  interconnected  subsystems 

The  desired  output  of  Xi  was  xm\{k)  =  5.0sin(^p)  (the  other  desired  outputs  are  not  included  to  conserve 
space).  It  is  to  be  pointed  out  that  in  all  cases  the  states  in  all  subsystems  converged  to  their  desired  values  with 
very  small  error. 

The  table  given  above  shows  the  dramatic  improvement  in  performance  with  communication  even  at  very  few 
instants.  In  particular,  a  threshold  of  5  results  in  an  overshoot  that  is  almost  the  same  as  that  which  results  when 
complete  communication  is  permitted,  with  only  about  0.3%  of  the  amount  of  communication.  Each  of  these  two 
overshoots,  in  turn,  were  better  than  when  there  was  no  communication  (T  =  00).  This  clearly  demonstrates  the 
significant  improvement  in  performance  due  to  communication,  even  if  the  latter  is  done  relatively  infrequently. 
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5  Conclusions 


Although  it  has  been  theoretically  proved  that  interconnected  subsystems  can  achieve  zero  tracking  errors  without 
any  communication  by  using  the  desired  outputs  in  place  of  the  actual  ones,  such  a  control  scheme  may  not  be 
practically  viable  due  to  extremely  large  transient  errors  before  they  converge  to  zero.  It  has  been  predicted 
in  previous  papers  by  the  authors  that  communication  between  subsystems  is  essential  to  improve  performance 
and  robustness  of  such  decentralized  adaptive  control  schemes.  A  question  consequently  arises  as  to  how  much 
communication  is  needed  to  have  a  satisfactory  transient  error. 

It  is  demonstrated  in  this  paper  that  since  there  is  a  Common  Quadratic  Lyapunov  Function  (CQLF)  for  the 
two  systems  resulting  from  both  communication  and  no  communication,  stability  of  the  overall  scheme  is  guaranteed 
for  any  arbitrary  switching  between  the  two.  Hence,  the  decision  to  communicate  can  be  made  on  considerations 
based  entirely  on  control  performance  and  communication  costs.  It  has  been  demonstrated  through  simulation 
studies  in  the  paper  that  a  performance  comparable  to  that  obtained  with  full  communication  can  be  realized  with 
communication  at  only  a  few  instants  during  the  period  when  the  transient  error  is  relatively  large. 
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Figure  1:  Classes  of  subsystems  considered 
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(a)  Control  error  for  xl 
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(c)  Control  error  for  x3 
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k 

Figure  2:  Control  errors  and  communication  switching  instants  for  two  subsystems  example  with  threshold  T  =  5; 
(a)  and  (c):  control  errors  for  X\  and  X3;  (b)  and  (d):  switching  instants  in  communicating  x\  and  X3  (with  1 
indicating  communication  and  0  indicating  no  communication) 
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